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Abstract 

The concept of double nonnegativity of matrices is generalized to doubly nonnegative tensors 
by means of the nonnegativity of all entries and JT-eigenvalues. This generalization is defined for 
tensors of any order (even or odd), while it reduces to the class of nonnegative positive semidefinite 
tensors in the even order case. We show that many nomregative structured tensors, which are 
positive semidefinite in the even order case, are indeed doubly nonnegative as well in the odd order 
case. As an important subclass of doubly nonnegative tensors, the completely positive tensors 
are further studied. By using dominance properties for completely positive tensors, we can easily 
exclude some doubly nonnegative tensors, such as the signless Laplacian tensor of a nonempty 
m-uniform hypergraph with m > 3, from the class of completely positive tensors. Properties 
of the doubly nonnegative tensor cone and the completely positive tensor cone are established. 
Their relation and difference are discussed. These show us a different phenomenon comparing 
to the matrix case. By employing the proposed properties, more subclasses of these two types 
of tensors are identified. Particularly, all positive Cauchy teirsors with any order are shown to 
be completely positive. This gives an easily constructible subclass of completely positive tensors, 
which is significant for the study of completely positive tensor decomposition. A preprocessed 
Fan-Zhou algorithm is proposed which can efficiently verify the complete positivity of nonnegative 
symmetric tensors. We also give the solutioir analysis of tensor complementarity problems with 
the strongly doubly nonnegative tensor structure. 

Key words, doubly nonnegative tensors, completely positive tensors, JT-eigenvalues, copositive 
tensors, structured tensors 
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1 Introduction 

Doubly nonnegative matrices and completely positive matrices have attracted considerable attention 
due to their applications in optimization, especially in creating convex formulations of NP-hard prob¬ 
lems, such as the quadratic assignment problem in combinatorial optimization and the polynomial 
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optimization problems (see [n 1 n nzi [nj [M] and references therein). In recent years, an emerging 
interest in the assets of multilinear algebra has been concentrated on the higher-order tensors, which 
serve as a numerical tool, complementary to the arsenal of existing matrix techniques. In this vein, 
the concept of completely positive matrices has been extended for higher-order tensors and properties 
of this special nonnegative tensors have been exploited in [43]. In this paper, the double nonnegativity 
will be extended from matrices to higher-order tensors, which contains the completely positive tensors 
as an important subclass. Properties on doubly nonnegative tensors and completely positive tensors 
will be exploited and further developed. 

It is well-known that the double nonnegativity of a symmetric matrix refers to the nonnegativity of 
all entries and eigenvalues [iiz]. Thus, it is reasonable to define the doubly nonnegative tensor by the 
nonnegativity of all entries and i7-eigenvalues of a symmetric tensor. Formally, a doubly nonnegative 
tensor is defined as follows. 

Definition 1.1 A symmetric tensor is said to be a doubly nonnegative tensor if all of its entries 
and H-eigenvalues are nonnegative; A symmetric tensor is said to he a strongly doubly nonnegative 
tensor if all of its entries are nonnegative and all of its H-eigenvalues are positive. 

Noting that nonnegative tensors always have ^-eigenvalues |S2], the above concepts are well- 
defined for tensors of any order (even or odd). Particularly, inspired by the criterion for positive 
semidefinite (definite) tensors as shown in [38], a (strongly) doubly nonnegative tensor is exactly a 
positive semidefinite (definite) tensor with nonnegative entries when m is even. Thus, many even- 
order symmetric tensors, such as the diagonally dominant tensors, the generalized diagonally dominant 
tensors, the i?-tensors, the complete Hankel tensors, the strong Hankel tensors, the MBo-tensors, the 
quasi-double i?o-tensors, the double i?o-tensors, and the i?o-tensors, which are positive semidefinite, 
are therefore doubly nonnegative if they are symmetric and nonnegative. A natural question is: 
Are the aforementioned structured positive semidefinite tensors with nonnegative entries still doubly 
nonnegative in the odd order case? An affirmative answer will be given in this paper. 

Odd order tensors are extensively encountered in many fields, such as the odd-uniform hyper¬ 
graphs, the diffusion tensor imaging, and signal processing. As an important concept in spectral 
hypergraph theory, the largest Laplacian Fl-eigenvalue and its relation to the largest signless Lapla- 
cian i/-eigenvalue for odd-uniform hypergraphs have been studied and characterized [HmSD], which 
shows a different phenomenon from that in the even case. In non-Gaussian diffusion tensor imaging, 
the even-order tensors only affect the magnitude of the signal, whereas odd-order tensors affect the 
phase of the signal [34]. And the independent component analysis, a computational method for sep¬ 
arating a multivariate signal into additive subcomponents in signal processing, adopts a third-order 
tensor diagonalization which is shown to be very efficient since for third-order tensors, the compu¬ 
tation of an elementary Jacobi-rotation is again equivalent to the best rank-one approximation just 
like the case of fourth order tensors does [5S]. All these wide applications indicate the significance 
and merits of odd order tensors in tensor theory and analysis. As a fundamental and essential ingre¬ 
dient of tensor analysis, positive semidefiniteness has been extensively studied for even order tensors 
[TU] [II iMi 133 ini i iMiiMi snuniiii miss] , but it vanishes for odd order tensors. The concept of 
doubly nonnegative tensors as proposed in Definition ll.il to some extent, has partially made up this 
deficiency in theory. 

Analogous to the matrix case, completely positive tensors form an extremely important part of 
doubly nonnegative tensors. They are connected with nonnegative tensor factorization and have wide 
applications [HEllliSllle]. As an extension of the completely positive matrix, a completely positive 
tensor admits its definition in a pretty natural way as initiated by Qi et al. in [43j and recalled below. 
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Definition 1.2 A tensor A € Sm,n is said to he a completely positive tensor if there exist an integer 
r and some € K”, k € [r] such that A = . A tensor A G Sm,n is said to be a 

k=l 

strongly completely positive tensor if there exist an integer r and some € K", k € [r] such that 
and span{u^^\ ... = M.'^. 

k=l 

It is worth pointing out that both in Definitions 11.11 and 11.21 the second parts, which are new concepts 
developed in this paper, can be regarded as counterparts tailored for all order tensors to the positive 
definiteness solely customized for even order tensors. 

All completely positive tensors contribute a closed convex cone in symmetric tensor space, associ¬ 
ated with the copositive tensor cone as its dual [321143]. Optimization programming over these two 
closed convex cones in the matrix case has been widely studied in the community of combinatorial 
optimization and quadratic programming HlllIHlIlS]. In spite of the better tightness of completely 
positive cone relaxation comparing to the well-known positive semidefinite relaxation, the former one is 
not computationally tractable. As a popular relaxation strategy, the doubly nonnegative matrix cone 
is always treated as a surrogate to the completely positive matrix cone due to its tractability of the 
involved double nonnegativity m- Many research works on these two cones emerged, not only on the 
algebraic and geometric properties of the cones [ElliailllES], but also the relation and the difference 
between them lilllTlIli]. Along this line of research, the completely positive tensor cone was employed 
to reformulate polynomial optimization problems which are not necessarily quadratic [37] . Numerical 
optimization for the best fit of completely positive tensors with given length of decomposition was 
formulated as a nonnegative constrained least-squares problem in Kolda’s paper |28j . A verification 
approach in terms of truncated moment sequences for checking completely positive tensors was pro¬ 
posed and an optimization algorithm based on semidefinite relaxation for completely positive tensor 
decomposition was established by Fan and Zhou in their recent work |21j . In this paper, the properties, 
together with their relation and difference will also be investigated for the doubly nonnegative tensor 
cone and the completely positive tensor cone, which somehow shows a different phenomenon from the 
matrix case. A noteworthy observation is the dominance properties of completely positive tensors. 
These properties turn out to be a very powerful tool to exclude some higher-order tensors, such as 
the well-known signless Laplacian tensors of nonempty m-uniform hypergraphs with m > 3, from the 
class of completely positive tensors. More subclasses of doubly nonnegative tensors and completely 
positive tensors will be discussed. In particular, we show that positive Cauchy tensors of any order 
are completely positive. This provides another sufficient condition for completely positive tensors. As 
an application, a preprocessing scheme for checking complete positive tensors based on the zero-entry 
dominance property and a simplified strong dominance property is proposed. Another application is 
the solution analysis of tensor complementarity problems with strongly doubly nonnegative tensors. 

The rest of the paper is organized as follows. In Section 2, we briefly review some basic concepts and 
properties on symmetric tensors, and definitions of several structured tensors that will be discussed 
in the subsequent analysis. The doubly nonnegative tensors and their properties will be discussed 
in Section 3, where we show that several structured tensors, which are positive semidefinite in the 
even order case, are all doubly nonnegative in the odd order case as well, provided that they are 
symmetric and entry-wise nonnegative. Section 4 is devoted to the completely positive tensors and 
their properties, including the dominance properties which are very useful to exclude some tensors 
from the complete positivity. Particularly, an interesting finding is all signless Laplician tensors 
of nonempty m-uniform hypergraphs with m > 3 are not completely positive. In order to get a 
further understanding on doubly nonnegative tensors and completely positive tensors, the doubly 
nonnegative tensor cone and the completely positive tensor cone, together with their geometric and 
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algebraic properties, are discussed in Section 5. The relation and difference of these two cones are 
also analyzed which bring out a more complicated phenomenon compared to the matrix case. More 
subclasses of nonnegative tensors and completely positive tensors are investigated in Section 6. A 
preprocessing scheme for completely positive tensor verification and decomposition, along with some 
numerical tests, is stated in Section 7. The solution existence of tensor complementarity problems 
with the strongly doubly nonnegative tensor structure is characterized as well. Concluding remarks 
are drawn in Section 8. 

Some notations that will be used throughout the paper are listed here. The n-dimensional real 
Euclidean space is denoted by R”, where n is a given natural number. The nonnegative orthant in 
M" is denoted by M", with the interior R"_|_ consisting of all positive vectors. The n-hy-l real matrix 
space is denoted by Denote [n] := {1, 2,..., n}. Vectors are denoted by lowercase letters such 

as X, u, matrices are denoted by capital letters such as A, P, and tensors are written as calligraphic 
capital letters such as A, B. The space of all real mth order n-dimensional tensors is denoted by Tm,n, 
and the space of all symmetric tensors in Tm.n is denoted by Sm,n- For any closed convex set M, a 
closed convex subset F is said to be a face of M if any x, y G M satisfying x + y & ¥ implies that x, 
y We use F < M if F is a face of M. For a subset T C [n], |r| stands for its cardinality. 

2 Preliminaries 

2.1 Symmetric Tensors and Eigenvalues 

Let A = be an mth order n-dimensional real tensor. A is called a symmetric tensor if 

the entries are invariant under any permutation of their indices for all ij G [n] and j G [m], 

denoted as M G §m,n- A symmetric tensor A is said to be positive semidefinite (definite) if Ax^ := 
X) ‘> 0(> 0) for any x G R" \ {0}. Here, x™ is a rank-one tensor in 

defined as := Xi^ • • • Xi^ for all ii, ..im € [n]. Evidently, when m is odd, A could not 

be positive definite and A is positive semidefinite if and only if A = O, where O stands for the zero 
tensor. A tensor A G is said to be (strictly) copositive if Ax™ > 0 (> 0) for all x G R" \ {0}. 
The definitions on eigenvalues of symmetric tensors are recalled as follows. 

Definition 2.1 ([38]) Let A G o,nd C be the complex field. We say that (A, x) G C x (C" \ {0}) 
is an eigenvalue-eigenvector pair of A if Ax"^~^ = Xx^^~^\ where and are all n- 

dimensional column vectors given by 

(Alx™“^). := ^ aii^...i^Xi^ ■ ■ ■ Xi^, = x™“\ Vi G [n]. (2.1) 

If the eigenvalue A and the eigenvector x are real, then A is called an H-eigenvalue of A and x an 
H-eigenvector of A associated with A. If x € R!Jl(R" + ), then A is called an H^{H'^^)-eigenvalue of 

A. 

Definition 2.2 ( |38 | ) Let A G §m,n and C be the complex field. We say that (A, x) G C x (C" \ {0}) 
is an E eigenvalue-eigenvector pair of A if Ax'^~^ = Ax and x'^x = 1, where Ax'^~^ is defined as in 
(2.1). If the E-eigenvalue A and the eigenvector x are real, then A is called a Z-eigenvalue of A and 
X a Z-eigenvector of A associated with A. 

2.2 Structured Tensors 

Several structured tensors are recalled which will be studied in the sequel of the paper. 
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Definition 2.3 (Definition 3.14, [53]) We call A € Tm,n o, diagonally dominant tensor if 

\au...i\> ^ G [n]. (2.2) 


A is said to be strictly diagonally dominant if the strict inequality holds in (2.2) for all i € [n]. 

For any A G Sm,™, and any invertible diagonal matrix D = diag{di,..., dn), define AD^~™' D ■ — D 

m —1 

as 



— ^^2 * * * 5 ^ ^ [^] ■ 


(2.3) 


Definition 2.4 ( |15L f26] i A tensor A is called (strictly) generalized diagonally dominant if there 
exists some positive diagonal matrix D such that AD^~^ P' defined in (2.3), is (strictly) 

m—1 


diagonally dominant. 


Definition 2.5 ( |41| i Let A = (oii...^^) G Tm,n- If there is a vector v = (fo, ■ ■ ■,G 
R("-i)™+i such that 

- him—^ J ^ (^■^) 

then we say that A is an mth order n-dimensional Hankel tensor. Let A = {aij) be a x 

|- (n-i^77i+2 -| ffiatrix with Oij := Vi+j- 2 , where r’np (n-i)m+ 2 .| is an additional number when 

(n — l)m is odd. Lf A is positive semidefinite, then A is called a strong Hankel tensor. Sup- 
pose A is a Hankel tensor with its Vandermonde decomposition A = ak , where := 

fc=i 

(1, ^fc,..., ik G R, for all k G [r]. If ak > 0 for all k G r, then A is called a complete Hankel 

tensor. 


Definition 2.6 ([l5l|26]) A tensor A is called a Z-tensor if there exists a nonnegative tensor B 
and a real number s such that A = si — B. A Z-tensor A = si — B is said to be an M-tensor if 
s > p{B), where p{B) is the spectral radius of B. If s > p{B), then A is called a strong M-tensor. 
The comparison tensor of a tensor A = ( 0 ^,...^^) G Tm,n, denoted by M{A), is defined as 




I®ii...im li if il — • ■ • — im! 
— otherwise. 


A is called an H-tensor (strong H-tensor) if its comparison tensor M{A) is an M-tensor (strong 
M-tensor). 


Definition 2.7 ([42]) A tensor A = G Tm,n is called a Bo-tensor if 

^ ^ Oii2...i.,j, ^ 0 

i2,....imG[n] 


and 


'i2T--,imG[n] 


— ^(j2j ■ • ■ ijm) ^ (^5 ■ • ■ ; ^)- 
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In [301 [3T], the i3o(-B)-tensor has been generalized and further studied. For any tensor A = 
^ ^m,n 5 denote 


MA) 


max Ai(A) := 

jmeN 




and Aj := Aj(A) — (/3j(A) — i ^ j. As defined in [3D], A is called a double B-tensor if 

> PiiA) for all i € [n] and for all i, j S [n], i ^ j, ai,,,i > Ai{A) and {ai,,,i—Pi{A)){aj,,,j—Pj{A)) > 
AM)^jiA). If a,.. ,i > j3i{A) for all i G [n], and 


- Pi{A)){aj,„j - Pj{A) - A*(^)) > (/3j(^) - aji,„i)Ai{A), 
then A is called a quasi-double Bq tensor. Let A = ( 0 ^^...^^) G Tm,n and set 

for any ij G [n] and j G [m]. If B := is an M-tensor, then A is called an MBo-tensor. If B is 

a strong M-tensor, then A is called an MB-tensor. 


Definition 2.8 ( |10| I Let c = (ci,...,c„)^ G K” with Ci ^ 0 for all i £ [n]. Suppose that C = 
G Tm,n is defined as 

Cii...im = - , Vij G [n], j G [m]. 

“r * * * “r 

Then, we say that C is an mth order n-dimensional symmetric Cauchy tensor and the vector c = 
(ci,..., c„)^ G M" is called the generating vector of C. 

Definition 2.9 (IH) Let A = G Tm.n- If for all ij G [n — I] and all j G [to], we have 

then A is called an mth order n-dimensional Toeplitz tensor. Lfforij, kj G [n], 
kj = ij -\-l mod (n), j G [to], we have then A is called an mth order n-dimensional 

circulant tensor. For a circulant tensor A, let Ak '■= jm-i) ^ be defined as a!'^^ j^_^ := 

Ak is said to be the fcth row tensor of A for fc G [n]. Particularly, Ai is called the root 
tensor of A and cq '.= is called the diagonal entry of A. 


Definition 2.10 ( |40] I Let G = {V, E) be an m-uniform hypergraph. The adjacency tensor of G is 
defined as the mth order n-dimensional tensor A whose (ii,..., im)th entry is 


. ..im 


(m— 1 )! ’ */ {*1 1 ■ ■ • I *m} S Hi 

0, otherwise. 


Let T) be an mth order n-dimensional diagonal tensor with its diagonal element di,,,i being di, the 
degree of vertex i, for all i G [n]. Then Q := V -\- A is called the signless Laplacian tensor of the 
hypergraph G. 


3 Doubly Nonnegative Tensors 

Properties on doubly nonnegative tensors are discussed in this section with mainly two parts. The 
first part is devoted to some necessary and/or sufficient conditions for doubly nonnegative tensors, 
and the second part is dedicated to establishing the double nonnegativity of many structured tensors. 
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3.1 Necessary and/or Sufficient Conditions 

We start with some necessary and sufficient conditions for doubly nonnegative tensors by means 
of some special types of linear operators. Besides the one defined as in (2.3), we also invoke the 
following linear operator as introduced in [55] , which possesses the decomposition invariance property 
as discussed in [36]: Let P = (pij) G Define a linear operator P"* as 

Proposition 3.1 Suppose A G Sm,n is a nonnegative symmetric tensor. We have 

(i) for any given positive diagonal matrix D G A is (strongly) doubly nonnegative if and only 

if AD^~^ p ■ ■ ■ is nonnegative and all of its H-eigenvalues are nonnegative (positive); 

m — l 

(a) for any permutation matrix P G A is (strongly) doubly nonnegative if and only if P"^A 

is (strongly) doubly nonnegative. 

Proof, (i) follows directly from the fact that the eigenvalues of A coincide with those of AD^~'^ DyD 

m—l 

as you can see in Proposition 2.1 of |26j . (ii) The nonnegativity is trivial. For any permutation matrix 
P and any x G R", since Ax’^~^ = Ax’"~^ if and only if P'"^(Px)’"“^ = A(Pa;)"*“^, one has that x 
is an iJ-eigenvector of tensor A associated with A if and only if Px is an il-eigenvector of tensor P'^A 
associated with A. In other words, the iL-eigenvalues of A and P^A are the same for any permutation 
matrix P G R”^". Thus (ii) is obtained. □ 

A sufficient condition is provided as below for the double nonnegativity, which will be very useful 
in the subsequent analysis. 

Proposition 3.2 Suppose A is a nonnegative tensor and A = B + C with B = '^ and 

k=l 

C = where G R" and G R" for all k G [ri] and j G [r 2 ]. If there exists some 

j=i 

io G [n] such that > 0 for all k G [ri], then A is doubly nonnegative. 

Proof. The assertion is obvious for even order m due to the convexity of the positive semidefinite 
tensor cone. Efforts are then made on the case of odd m. For any iL-eigenvalue of A with its associated 
P-eigenvector x, we have 

ri m—l m — l 

= {Ax"^-^). = ^ ^ (x'^v’'^'>^ v\^\ Vi € [n]. (3.1) 

fc=i j=i 

If x'^u^^'> = 0 for all k G [ri], along with a; 0, we can find some i G [n] such that x^ ^ 0 and 

hence A = — -- > 0. If there exists some k G [ri] such that 0, (3.1) yields that 

Ax”(“^ > 0. Thus A > 0. This completes the proof. □ 

The condition as required in Proposition [52] is sufficient but not necessary for the double nonneg¬ 
ativity as you can see in the following example. 
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Example 3.3 LetA = B + C with B = + ((-1,0,0)'^)^ and C = It is 

easy to verify that A is nonnegative and B does not satisfy the eondition as stated in Proposition \3.A 
Furthermore, it is impossible to find any rank-one decomposition for B to satisfy the desired condition 
since bm = 6222 = 0 and 6333 = —1. However, A is still doubly nonnegative. We can show the 
nonnegativity of all H-eigenvalues of A by contrary. Assume that there exists some H-eigenvalue 
A < 0 with its assoeiated H-eigenveetor x. By definition, we have 


Ax^ = (xi — xs)^ 

1 

0 

-h xl 

■ -1 ■ 

0 

-1- {xi +X 2 + Xs)^ 

■ 1 ■ 

1 

= A 

■ xl ' 
xl 


_ -1 _ 


0 


. 1 . 


. xl . 


By the seeond equation, we have X 2 = 0 and xi = —X 3 7 ^ 0 since x ^ 0. Substituting these values into 
the first equation, it follows that A = 3 whieh is a contradietion to the assumption that A < 0. 

3.2 Double Nonnegativity of Structured Tensors 

Many even-order structured tensors have been shown to be positive semidefinite, such as the diagonally 
dominant tensor, the generalized diagonally dominant tensor, the i7-tensor with nonnegative diagonal 
entries, the complete Hankel tensor, the strong Hankel tensor, the MBo-tensor, the quasi-double Bo- 
tensor, the double Bg-tensor and the Bp-tensor. For the odd order case, we will prove that with 
nonnegative entries, they are all doubly nonnegative as well, as the following theorem elaborates. 

Theorem 3.4 Let A be a nonnegative symmetric tensor. If one of the following eonditions holds 

(i) A is a diagonally dominant tensor; 

(ii) A is a generalized diagonally dominant tensor; 

(Hi) A is an H-tensor; 

(iv) A is a complete Hankel tensor; 

(v) A is a strong Hankel tensor; 

(vi) A is an MBg-tensor; 

(vii) A is the signless Laplacian tensor of a uniform m-hypergraph; 
then A is a doubly nonnegative tensor. 

Proof, (i) The nonnegativity of iJ-eigenvalues follows from Theorem 6 in [55]. (ii) By definition, 
we can find some positive diagonal matrix D such that AD"^~^ is diagonally dominant. This further 
implies that B AD^~'^ D ■ ■ ■ D is diagonally dominant, and hence all B^-eigenvalues are nonnegative. 

771—1 

Applying Proposition 13.11 we can get (ii). (iii) The desired assertion can be obtained by invoking 
Theorem 4.9 in [^, together with (ii). (iv) For any complete Hankel tensor A with its Vandermonde 
decomposition 

k^l 

where Uk > 0, = (ij.ffc, ■ • ■ for all k € [r], the desired assertion follows readily from 

Proposition 13.21 bv setting ig = 1 and C = 0. (v) It is known from [16] that for any strong Hankel 
tensor A G Sm,m it has an augmented Vandermonde decomposition 

k^l 
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(3.2) 










where ak > 0, = (l, ..., G R", G R, for all fc G [r — 1], a^. > 0 and G R" 

is the nth column of the identity matrix. Utilizing Proposition 13.21 again, we can get the double 
nonnegativity of any nonnegative strong Hankel tensors, (vi) It is known from Theorem 7 in |31) that 
for any nonnegative symmetric MBo-tensor A, either is a symmetric M-tensor itself or we have 

S 

fc=i 

where is a symmetric M-tensor, s is a positive integer, hk > 0 and Jk C [n], for k = I,-- - ,s. 
When m is even, the desired result can be derived from the positive semidehniteness. When m is odd, 
the assertion is obvious when A is an M-tensor. To show for the latter case, we first claim that for 
any symmetric M-tensor Ai and any vector x G R" \ {0}, there always exists some i G supp{x) := 
{i G [n] : Xi ^ 0} such that (^A4x'^~^). > 0. Assume on the contrary that there exists some nonzero 
X such that for any i G supp{x), . < 0. Let a, = — for all i G supp{x). 

Obviously, > 0 for all i G supp{x). Thus, I M + ] 5;™“^ = 0, where JA is the 

Y i^supp{x) j 

principal subtensor of M. and x the sub-vector of x generated by the index set supp{x). This comes 
to a contradiction to the fact that JA + oci is a strong M-tensor by the property of 

i^supp{x) 

M-tensors. This shows our claim. Now for any iL-eigenvalue of A with its associated M-eigenvector 
X, we have 

S 

Ax--' = (Ax—'), = (Mx—'), + ^ , W G [n]. 

fe=i 

From our claim, we can find some i G supp{x) such that (Mix—> 0 and hence A = > 0. 

(vii) By definition, the signless Laplacian tensor is a nonnegative tensor. By [40], all M-eigenvalues 
of the signless Laplacian tensor are nonnegative. Hence, it is a doubly nonnegative tensor. This 
completes the proof. □ 

Remark 3.5 It has been shown in llfA fM]/ that 

{Bo-tensors} C {double Bo-tensors} C {quasi-double Bo-tensors} C {MBo-tensors}. 

From (vii) in Theorem \3.4\ all these tensors with nonnegative entries are doubly nonnegative when 
they are symmetric. 

Similarly, we can get the following results on strongly doubly nonnegative tensors. 

Proposition 3.6 Let A G Sm,n be a nonnegative symmetric tensor. If one of the following conditions 
holds 

(i) A is a strictly diagonally dominant tensor; 

(ii) A is a generalized strictly diagonally dominant tensor; 

(Hi) A is a strong H-tensor; 

(iv) A is an MB-tensor (or B-tensor, or quasi-double B-tensor, or double B-tensor); 
then A is a strongly doubly nonnegative tensor. 

Proposition 3.7 Let A G Sm,n be a nonnegative circulant tensor with its root tensor Ai and its 
diagonal entry cq. If 2co — Aie™> 0, then A is doubly nonnegative. 

Proof. By Definition 12.91 the condition 2co — Are—> 0 implies that A is diagonally dominant. 
Thus, Theorem 13.41 immediately leads to the desired result. □ 
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For circulant tensors, we also get the following properties on copositivity, which can be regarded 
as necessary conditions for the double nonnegativity. 

Theorem 3.8 Let A € Tm,n be a circulant tensor with its root tensor Ai- If Ai is copositive (strictly 
copositive, respectively), then A is eopositive (strictly copositive, respectively). Moreover, if A is a 
doubly eirculant tensor, then A is copositive (strictly copositive, respectively) if and only if Ai is 
copositive (strictly copositive, respectively). 

Proof. Let be the (ii,..., *m)th entry of A and Ak {k G [n]) be its row tensors. Invoking 

Proposition 2 in m, we have Ak+i = P"^{Ak), where P = {pij) G is a permutation matrix 

with pi+ii = 1 for z G [n — 1], pin = 1 and pij = 0 otherwise. If Ai is copositive, then for any x G K”, 
P " ' Pa £ R+,Vfe G [n] and 

fc-i 


Ax'^ = Y,XkAkx'^-^ = Y,XkAi{P_^)"" =Y,XkAi{P_^x)"" ^> 0 , 

fe=l fc=l k-l k=l k-l 


where the last inequality follows from the copositivity of Ai- Since P ■ ■ ■ P x G R" \ {0},Vfc G [n] for 

k-l 

any x G M" \ {0}, we can similarly show the case of strict copositivity of A if Ai is strictly copositive. 
To get the moreover part, it suffices to show the necessity. By the definition of doubly circulant tensor, 
we have all row tensors Ak coincide with its root tensor Ai. Thus 


Ax"^ = J2^kAkX^-^ 



Aix^-\Vx£R^. 


If A is copositive, for any x G R” \ {0}, ^k > 0- Thus, Aix 


m—1 


k^l 


shows the copositivity of Ai. Similarly, we can prove the strictly copositive case. 


= / ( E ) > 0. This 

fc=i 


□ 


4 Completely Positive Tensors 

Completely positive tensors form an important subclass of doubly nonnegative tensors. In this section, 
many useful properties are explored for this special class of tensors. We start by the dominance 
properties which serve as a powerful tool for excluding many nonnegative tensors from the set of 
completely positive tensors. 

4.1 Dominance Properties 

Dominance properties of completely positive tensors were studied in |43| . 

Definition 4.1 A tensor A G Sm,n is said to have the zero-entry dominance property if ai.,,,,i^ = 0 
implies that = 0 for any (ji,..., j„) satisfying {ji,... ,jm} 2 {*i, • ■ •, *m}- 

Proposition 4.2 If A is a completely positive tensor, then A has the zero-entry dominance property. 

Proof. This follows directly from Theorem 3 in [IJ]. □ 
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Utilizing the zero-entry dominance property, we can exclude some doubly nonnegative tensors from 
the class of complete positive tensor very efficiently. 

Proposition 4.3 The signless Laplacian tensor of a nonempty uniform m-hypergraph for m > i is 
not completely positive. 

Proof. Suppose that m > 3 and G is a nonempty uniform m-hypergraph. Suppose that (ji, • • • ,jm) 
is an edge of G. Let Q = & Sm,n be the signless Laplacian tensor of G. By definition, 

- Note that qjiji...jij 2 = 0 by the definition of signless Laplacian tensors. 

Obviously, the zero-entry dominance property fails and hence Q is not completely positive. □ 

Proposition 4.4 Let A G Sm,n be a Hankel tensor, and v = (vo, ■ ■ ■ S be its 

generating vector. 

(i) Ifvo = = 0, then A G GPm,n if and only if A = O; 

(a) If A G GPm,n and = 0 for some 2 < i < n — 1, then vq > 0, ^ 0 and 

A = Voef' + V(^n-l)7nen ; 

(Hi) If Vo = 0 and vj 0 for some j G [m — 1], then A is not completely positive. 

Proof, (i) It is trivial that O is a completely positive tensor. If A is completely positive and 
■*^0 = n(^n-i)m = 0, then 01 ^ 2 ,,.^,,^ = 0 for all 12 , ..., im G [n]. Thus Vj = 0, for any j G [(m—l)n-|-l —m]. 
When n=2, then .4 = 0. When n > 3, then n > 2+:^^, which implies that m > {m—l)n+l—m. Thus 
02...2 = 0. Using the zero-entry dominance property again, we get Uj = 0forallj G [(m—l)n-|-2 —m]. 
Keep on doing this, we can find that for any given k G = Q for all j G [{m —I)n-|-fc—1 — m], 

then ak...k = 0 since n > The zero-entry dominance property and the fact V(^n-i)m = 0 finally 

give US = 0. Thus (i) is obtained. Using the similar proof as in (i), we can prove that ak...k = 0 
for all k = 2,... ,n — 1. Thus, the zero-entry dominance property shows A = Vqc^ + V(^n-i)ma’)(■ 
By the nonnegativity of A, vq and are nonnegative. This implies the assertion in (ii). By 

definition, we know that = 0. Theorem 14 .2 1 tells ns that = 0 for any (U, ■ • ■, im) satisfying 

1 G {ii,..., im}. Note that if ii + ■■■+ im < 2m — 1, then I G {ii,..., im}- This leads to (hi). □ 

Proposition 4.5 Let A be a Toeplitz tensor with its diagonal entry 0. Then A is completely positive 
if and only if A = O. 

Proof. The sufficiency is trivial. If A is completely positive and ai...i = 0, by the definition of 
Toeplitz tensors, we have = 0 for all i G [n]. Invoking the zero-entry dominance property in 
Theorem 14.21 it follows that A = O. □ 

The zero-entry dominance property may work very well for excluding some doubly nonnegative 
tensors with zero entries from the class of completely positive tensors. The strong dominance property, 
as described below, may work for the case of some other doubly nonnegative tensors that may have 
all positive entries. 

Let I = ■ Um ) I with ■ • ■, } C {ji,...,jm} for any p e [s]. 

For any given index i G {ji,... ,jm}, if it appears t times in {ji, ■ • ■ ,jm}, then it appears in I st 
times. Then we call I an s-duplicate of (ji,... ,jm)- 

Proposition 4.6 (Strong Dominance, Theorem 4, (43]) Suppose that A = G Sm,n is 

completely positive and = | (4^^ ■ • ■ > i i (^4^^ • ■ • > | an s-duplicate of (ji, ■ ■ • ,jm) for 

S 

some given ji G [n], I G [m]. Then ^ a.(p) .(p) > aj^,,,j,„. 

p=i 1 

The aforementioned strong dominance property provides ns a way to exclude some positive doubly 
nonnegative tensors from the class of completely positive tensors, as you will see in Section 7. 


II 



4.2 Spectral Properties 

It is known from |33] that completely positive tensors have the following spectral properties. 

Theorem 4.7 (Theorems 1,2 |43| 1 Let A € Sm,n be a completely positive tensor. Then 

(i) all H-eigenvalues of A are nonnegative; 

(ii) When m is even, all its Z-eigenvalues are nonnegative; When m is odd, a Z-eigenvector 
associated with a positive (negative) Z-eigenvalue of A is nonnegative (nonpositive). 

For strongly completely positive tensors, we have the following spectral properties. 

Theorem 4.8 Let A € Sm,n be a strongly eompletely positive tensor. Then 

(i) all H-eigenvalues of A are positive; 

(ii) all its Z-eigenvalues are nonzero. Moreover, when m is even, all its Z-eigenvalues are positive, 
when m is odd, a Z-eigenvector associated with a positive (negative) Z-eigenvalue of A is nonnegative 
(nonpositive). 

Proof. Write A as A = where G R” and 

k=l 

span{u^^\...,u^^^}=R'^. (4.1) 

(i) Assume on the contrary that A has A = 0 as one of its il-eigenvalues, and the corresponding 
il-eigenvector is x. Certainly x 0. When m is even, by the definition of iJ-eigenvalue, we have 

= Ax'" = ^ 

2—1 k—1 

The nonnegativity of each term in the summation on the right hand side immediately leads to = 

0 for all k G [r]. Invoking the condition in (4.1), x has no choice but 0, which comes to a contradiction 
since x is an H-eigenvector. Thus, all il-eigenvalues of A is positive when the order is even. When 
m is odd, it is known by definition that 

0 = Axf-i = ^ Vz G [n]. (4.2) 

fc=i 

Together with the involved nonnegativity of each term in the summation on the right hand side, (4.2) 
implies that 

=0, Vz G [rz]. (4.3) 

In addition, the condition (4.1) implies that we can pick n vectors from the set ..., to 

span the whole space M". Without loss of generality, let’s say they are ..., zz^"^. Trivially, for 
any fc G [n], 0. Therefore, there always exists an index z^ G [n] such that v^^^ ^ 0. Thus (4.3) 

implies that = 0, for all fc G [n]. This immediately leads to x = 0. The same contradiction 

arrives and hence all il-eigenvalues of A should be positive when m is odd. (ii) Assume on the contrary 
that A = 0 is a Z-eigenvalue with x as its Z-eigenvector. When m is even, it follows by definition that 

0 = Ax^x = Ax'" = ^ . 


0 = A^x” 
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Since each term > 0 (fe G [r]), it follows readily that = 0 for all k € [r]. In addition, 

together with (4.1), we get a; = 0, which contradicts to the assumption that a; is a Z-eigenvector. 
When m is odd, it comes directly that 

r m—1 

0 = Xx,= Ax"^ = uf\ Vi G [n]. 

k^l 

The nonnegativity of each term ) "* ^ for all k G [r] and all i G [n] yields 

(^x^u^Y = 0,Vfc G [r], Vi G [n]. (4.4) 

Pick up n linearly independent vectors from the set ..., simply say ..., By the 

observation that 0 for all fc G [n], we can always find some index i^ G [n] such that 0, 

for all fc G [n]. Substituting this into (4.4), we can obtain x'^A-^'> = 0 for all /c G [n]. This gives us 
a; = 0, which is a contradiction since x is a Z-eigenvector. This completes the proof. □ 

4.3 Necessary and/or Sufficient Conditions 

Some necessary and/or sufficient conditions for (strongly) completely positive tensors are presented 
in this subsection. 

Proposition 4.9 For any given nonnegative matrix P G if A is completely positive, then 

P^{A) is also completely positive. 

Proof. Let A = ^ , where G M". By employing the decomposition invariance in 

fe=i 

Theorem 2.2 of [35], we know that P™{A) = X] . If P is nonnegative, then so are PA^^ for 

fe=i 

all k € [r], □ 

Proposition 4.10 For any nonnegative nonsingular P G A is (strongly) completely positive if 

and only if P"^[A) is (strongly) completely positive. 

Proof. Let A = ^ , where G By employing the decomposition invariance in 

k^l 

r 

Theorem 2.2 of [35], we know that P'^{A) = . The nonsingularity of P implies that 

k—1 

span{PA^\ ... ,PA'^Y = span{A^\ ... and the nonnegativity of P implies that PA^'> G R" 

for all fc G [r]. Conversely if S := P™{A) is completely positive (definite), then similarly we can prove 
that A = (P“^)"* B is completely positive (definite). □ 

Proposition 4.11 Let A G Sm,n be a completely positive tensor. Then 

(i) for any even integer I G [to], Ax’’ G Sm-i,n is also completely positive for any x G R"; 

(a) for any integer t G [to], Ax* G Sm-t,n is also completely positive for any x G R”; 

(Hi) for any T C [n], the principal subtensor At G Sm,|r| is also completely positive. 

r 

Proof. Let A=^ where € M!J:. It follows that for any x € and any integer I G [m], 

k^l 

Ax^ =j2{x'^uY' . 

k=l 

Thus (i) and (ii) can be obtained by definition, (hi) is from Proposition 2 in [33] . □ 
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Similarly, we can get the following properties for strongly completely positive tensors. 

Proposition 4.12 Let A € Sm,n be a strongly completely positive tensor. Then 

(i) for any integer I G \m], Ax^ G §m-i,n is also strongly completely positive for any x G R++; 

(ii) for any T C [n], the principal subtensor Ar G §m.|r| Aso strongly completely positive. 

The Hadamard product preserves the complete positivity as shown in Proposition 1 in [JS] . It also 
preserves the strong complete positivity as stated below. 


Proposition 4.13 Let A, B G Sm,n- If A and B are strongly completely positive, then A o B is 
strongly completely positive. 

Proof. We first claim that if [/ = V = are any two nonsin¬ 
gular matrices in then 

span{u^^^ o o v^'^\ ..., o o o v^'^\ ..., o = K”. (4-5) 

The nonsingularity of Lf indicates that ..., can form a basis for R". Thus, we can find 

o-ik, i, S [n], such that 

n 

= ^^aikU^^\ Mi € [n], (4.6) 

k^l 

where there exists at least one nonzero element among an, ..., am for any i G [n]. The equalities in 
(4.6) derive that 

n 

g(b o ^ o , Vi, j G [n]. (4.7) 

k=l 

By the nonsingularity of P, it follows that 0 ^ det(P) =J2a&Sn where a = (cti, ..., cr„) 

is a permutation of [n], sgn{a) is the signature of cr, 5'„ is the set of all permutations of [n]. Thus, 
there always exists some permutation a such that ^ 0. Without loss of generality, we assume 

that CT = (1, 2,..., n), that is, 0 for all i G [n]. This together with (4.7) yields that 

n 


n 

which indicates that ^ o z;b)^ ^ for all i G \n]. Thus, ..., can be lin- 

fe=l ’'i 

early expressed by o and our claim is proven. Now we consider any two strongly 

completely positive tensors A and B with their corresponding nonnegative rank-one decompositions 

and B = , where span{u^^\ ... = span{v^^\ ... , 1 '^’' )} = R". Eas- 

i=i j=i 


ily we can verify that Ao B 


E E 


o . The involved o 


is certainly nonnegative 


i=ij=i 

by the nonnegativity of and for all i, j G [n\. Note that r and r should be no less than n. 
Therefore, we can always pick up n vectors from ..., m^®'^} to form a basis of R®®. Let’s simply 

say they are ..., u^®®^. Similarly, we can do this to ..., u*-®' ^ and get n linearly independent 
vectors, namely The aforementioned claim tells us that all involved vectors m^®^ o 

i, j G\n], can span the whole space R®®, which means .A o S is strongly completely positive. □ 
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5 Cones of Doubly Nonnegative Tensors 


In this section, many tensor cones and their relationship in the class of doubly nonnegative tensors 
are discussed. Particularly, the gap existing between the doubly nonnegative tensor cone and the 
completely positive tensor cone is analyzed. Following from the matrix case [7], the set of all doubly 
nonnegative tensors of order m and dimension n is denoted by DNNm,n- Similarly, we use SDNNm,n 
to denote the set of all strongly doubly nonnegative tensors in DNNm,n- Adopting the notations 
in the literature (see e.g., m). CPm,n and COPm,n are used to denote the sets of all completely 
positive tensors and all copositive tensors of order m and dimension n, respectively. In addition, 
SCPm,n and SCOPm,n are used to stand for the set of all strongly completely positive tensors and 
the strictly copositive tensors, respectively. The set of all symmetric positive semidefinite (positive 
definite) tensors is denoted by PSDm,n {PDm,n) for convenience. 


Proposition 5.1 If m is even, then DNNm,n = PSDm,n H Nm,n, SDNNm,n = PP>m,n H Nm,n, 
int{DNNm,n) = PP>m,n H V+ „ C SDNNm,n, where N+ ^ := {A £ Tm,n '■ ah-im > 0^ £ 

Nl- 

Proof. By dehnition, the desired assertions follow from Theorem 5 in [55]. □ 


Proposition 5.2 CPm,n o,nd COPm,n owe closed convex cones and they are dual to each other. More¬ 
over, 

0) CPrn.n C C COP^^r^i 

(ll) SCPm.u C SDNN^^r^ C SCOPm.n- 

Furthermore, let T C [n] and /r £ be the matrix with the {i, i)th entry lifi£T and 0 elsewhere. 

Then 

(ill) {Irr CPm.u < CPm,n; 

(iv) (Ir)^ DNNm,n ^ DNNm.n, when m is even. 

Proof. The first part is from Theorem 5 in [IS], (i) can be easily verified by (i) in Theorem 14.71 For 
(ii), the inclusion SCPm,n SDNNm.n can be derived from (ii) in Theorem l4.8l To get the remaining 
inclusion SDNNm,n C SCOPm.n, suppose A is a strongly doubly nonnegative tensor. By definition, 
all il-eigenvalues of A are positive, which implies that there exists no no-positive Tf^-eigenvalues. 
This further shows that all principal subtensors of A have no no-positive i7+“*"-eigenvalues. Applying 
Theorem 4.2 in |48|, A is strictly copositive. To get (hi), we first claim that {Ir)™‘ CPm,n C CPm,n- 
This follows from the fact that every principal subtensor of a completely positive tensor is completely 
positive (Proposition 2, [15]). Evidently, for any C £ (/r)™ CPm,n, we can always find some ..., 
y;(0 g such that 

i 

A = ^ = 0, Vj ^ F. (5.1) 

i=i ^ 

Now it remains to show that the following implication holds: 

A, B£ CPm,n. APB£ {Irr CPm.n ^ A, B £ {IrT CPm.n- 

Write 

r r 

, B = '^(v^^^y , u^'^\ £Wl,\Jk£ [r],j£ [r']. 
k=l 3 = 1 
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li A + B & CPm,n, invoking (5.1), it follows readily that 


k^l 




i=i 


,0) 


= 0, Vii,..., 


r. 


(5.2) 


By setting ii = i 2 = ■ ■ ■ = im = t foi' any t ^ T, (5.2) implies that = np'* = 0 for all k € [r], 
j S [r ] and t ^ T. Invoking the property of (/r)"^ CPm,n as shown in (5.1), we immediately get 
B G (/r)"* CPm,n- Thus (/r)™ CPm,n is a face of CPm,n for any T C [n]. Similarly, we can prove (iv). 
This completes the proof. □ 


It is known that all strongly completely positive tensors with even m are positive definite tensors 
by invoking Theorem id. 71 together with Theorem 5 in |38) . A natural question arises: Is it correct that 
any tensor with complete positivity and positive definiteness should be strongly completely positive? 
The following proposition answers it in an affirmative way. 

Proposition 5.3 Suppose m is even. Then CPm,n H PDm,n = SCPm,n- 

Proof. First we claim that CPm,n H PDm,n C SCPm,n- For any A G CPm,n H PDm,m write its 
nonnegative rank-one decomposition as A = ^ with yfP) g for all fc G [r]. Assume 

fe=i 

on the contrary that A ^ SCPm,n, which means span{A^\... ^ K". Thus, there exists an 

r 

X G ]R"'\{0} such that = 0 for all k G [r]. This immediately gives us Ax"^ = ^ = 0, 

k—1 

which is actually a contradiction to the hypothesis that A G PDm.n- Thus the claim is proven. On 
the other hand, for any A G SCPm.n- Apparently A G CPm,n and all i7-eigenvalues of A are positive 
by applying (ii) of Theorem 14.71 This positivity leads to A G PDm,n by Theorem 5 in [38]. Thus 
A G CPm,n n PDm,n and hence SCPm,n C CPm,n n PDm,n by the arbitrariness of A. This completes 
the proof. □ 

Note that PDm,n is empty in the odd order case. However, inspired by Proposition 15.II it yields 
that CPm,n n PDm,n = CPm,n O SDNNm,n when TO is even. Based on this observation, we can 
generalize the result in the above proposition to any odd order case, as the following theorem shows. 

Theorem 5.4 CPm,n H SDNNm,n = SCPm,n- 

Proof. Invoking Propositions l5.Il and l5.3l we only need to consider the odd order case. For any given 
A G CPm,n n SDNNm,n with its nonnegative rank-one decomposition A = (u^^^) . Assume on 

fc=i 

the contrary that A ^ SCPm,m which means span{A^\ ... ^ K". It is immediate to get some 

nonzero x G M" such that = 0, for all /c G [rj. This shows that 

(Ax^-^^ = E = 0, Vi G [n], 

k=l 

which indicates that 0 is an iV-eigenvalue of A. This contradicts to the hypothesis that A G SDNNm,n- 
Thus, CPm,n<^SDNNjn,n C SCPm,n- The reverse inclusion follows directly from (ii) of Theorem l4.7l 
This completes the proof. □ 

It has been shown in [39| that the interior of the copositive tensor cone is exactly the strictly 
copositive tensor cone, and the interior of DNNm,n is the cone consisting of all strongly doubly 
nonnegative tensors with positive entries. For the completely positive tensor cone, when its reduces to 
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the matrix case, i.e., m = 2, the interior has been well characterized in [niin]. Then how about the 
interior of the completely positive tensor cone in general higher order case? Some properties about 
the interior are discussed as follows. 


Proposition 5.5 

Proof. The inclusion int{CPm,n) C 7V+ „ is obvious. For the remaining part, the even order and the 
odd order cases will be analyzed separately. For the even order m, the inclusion CPm,n ^ DNNm,n 
as shown in (i) of Proposition 15.21 together with Proposition 15.11 yields that int{CPm,n) ^ PDm,n- 
Invoking Proposition 15.31 we have 

int{CPm,n) = int{CPm,n) n CPm,n C PPm.n H = SCPm,n- 

For the odd order m, let ^ ^ be any tensor in int{CPm,n)- It is known by the definition 

fc=i 

of interior that there exists some scalar e > 0 such that 

A + eB€ CP^^n, VP € Bi := {B G S™'" : (P,P) < 1}. 

Thus for any nonzero x G MP, 

((^ + eB)x^-^)^ = (Vlx—1)^ + ^ [vi% > 0,V* G [n], 

k^l 

where P = ^ with all G K” for any given P G Bi. By the arbitrariness of P, it is evident 

that for any nonzero x, there exists some j G [n] such that > 0 and Xj ^ 0. In this regard, 

for any P-eigenpair (A,a;) of A, due to the definition, we have (Ax"^~^'). = for all i G [n]. 

Combining with the aforementioned argument, there exists some j G [n] such that > 0 and 

Xj ^ 0 . This leads to A > 0 . Thus A G SDNNm,n and hence int{CPm,n) C SDNNm,n- Utilizing 
Theorem 15.41 it follows that 


int{CPm,n) = int{CPm,n) n CPm,n ^ SDNNm,n C CP^,„ = SCPm,n- 


□ 

It is worth pointing out that int{CPm,n) is a proper subset of SCPm,n H „ with to > 3, as the 
following example shows. 

Example 5.6 Let A '.= X + . It is easy to verify that A G SCPs^s fl ^^ 3 . Let B G § 3,3 with 

bus = bi 3 i = 6311 = 6223 = ^232 = ^322 = 1 , ^123 = &132 = ^213 = ^231 = ^312 = ^321 = — 1 ; and others 
zero. Then Bx^ = 3 a; 3 (a;i — X 2 )'^ > 0 for all x = {xi,X 2 ,X 3 )'^ G Thus B G COP^^^. However, 
{A,B) = 0. Thus A ^ int^CPs^s). 


In [13| . Dickinson has proposed an improved characterization of the interior of the completely 
positive cone for matrices, i.e., to = 2. Following his work, the interior can be characterized as 


tnt{CP 2 ,n) = < A G S 2 .n : fc=i > . 

I GR!l_^.,span{A^^ }—J 

A natural question is: Can we generalize this characterization to higher-order tensors and use the set 


INT = 


A e Sr, 


A=f:(A)^,A>‘ARl,Vie[r], ] 

k = l > 

,span{A^^ ,...,A^^ }—R^ J 
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to describe int(CPm,n) for general m and nl Unfortunately, the answer is no, as you can see the 
tensor A defined in Example 15.61 where A G INT \ int{CPm,n)- In [37], the sum of rank-one tensors, 
served as the standard basis of §m.n, is pointed out to be a special interior point in CPm,n- But the 
full characterization of the entire interior is unknown. 

Question 1: How to characterize int{CPm,n) for general m and n? 

In [T3| , it is shown that for any copositive matrix A, if there exists some positive x € MP such that 
Ax = 0, then A G PSD 2 ^n- For higher order copositive tensors, we have the following property 
which is weaker than the one in the matrix case. 

Proposition 5.7 If Ag COPm,n and there exists some x G R4.+ such that Ax'^ = 0, then Ax"^~^ = 
0 and Ax'^~^ G PSD 2 ^n- 

Proof. For any given u G M", there exists some oq > 0 such that for any a G (0, oq), x + au G K” . 
By the copositivity of A, it follows readily that 

m / m 

0 < + aur = Ax^ + a’^Ax^-'^u’^ = a Ax^-\ + ^ a'^-^Ax'^-'^u^ 

k—1 \ k—2 

which further implies that 

m 

Ax"^-'^u + '^c^’"~^Ax"^-’^u’^ > 0,Vm G K’". (5.3) 

k^2 

Let a —>■ 0. (5.3) immediately yields that Ax'^~^u > 0 for all u G W^. This indicates that Ax'^~^ = 0. 

m 

Substituting this into (5.3), we get Ax'^~'^u'^ + a^~'^Ax'^~^u^ > 0, for all u G M". Thus Ax"'~^ 

k=3 

is a positive semidefinite matrix. □ 

The above proposition also indicates that for a copositive tensor satisfying Ax"^ = 0 with some 
positive X, then 0 is an '^''"-eigenvalue of A and x is the corresponding if “'"'■-eigenvector. 

The gap existing between doubly nonnegative matrices and completely positive matrices has been 
extensively studied 13 lain]. The remaining part of this section will be devoted to the equivalence and 
the gap between the tensor cones DNNm,n and CPm,n- It is known from the literature of matrices 
that any rank-one matrix is completely positive if and only if it is nonnegative. This also holds for 
higher order tensors as the following proposition demonstrated. 

Proposition 5.8 A rank-one symmetric tensor is completely positive if and only if it is nonnegative. 

Proof. The necessity is trivial by definition. To show the sufficiency, note that for any rank-one 
symmetric tensor A = Ax'" to be nonnegative, we have x ^ 0, A ^ 0 and Ax^^ • • • Xi„ > 0, for all 
ii,... Am G [n]. If X has only one nonzero element, the desired statement holds immediately. If there 
exists at least two nonzero elements, we claim that all nonzero elements should be of the same sign. 
Otherwise, if Xi > 0 and Xj < 0, then Xx^~^Xj and Ax'""^x^ will not be nonnegative simultaneously. 
Thus all elements in x are either nonnegative or nonpositive. When m is even, we can easily get 
A > 0. Thus A is completely positive. If m is odd, we can get that > 0. Thus A is completely 

positive. □ 

The above proposition provides a special case that CPm,n coincides with DNNm,n- Generally, 
there exists a gap between DNNm.n and CPm,n- For example, if Q is the signless Laplacian tensor 
of a nonempty m-uniform hypergraph with to > 3, Theorem 13.41 and Proposition 14.31 lead to Q G 
DNNm,n \ CPm,n. Recall from [7] that for any matrix A G S2,n, if A is of rank 2 or n < 4 , 
A G DNN 2 ,n if and only if H G CPj.m- In other words, DNN 2 ,n = CP 2 ,n for these two cases. How 
about higher-order tensors? We answer this question in a negative way as follows. 
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Proposition 5.9 Let m > 3 and n >2. Then 

|a + oe™ : i,j £ [n\,i ^ j, a e R++| C DNNm,n \ CPm,n 


Proof. For simplicity, denote GAP := |a + oe™ : i,j £ [n\,i ^ j,a £ ]R++|. Then for 

any A = £ GAP, it follows from Proposition 13.21 that A £ DNNm,n- Additionally, it is easy 

to verify that A is rank-two. However, as we can see, ai,,,ij = 0 and = 2. This indicates that 

A breaks the zero-entry dominance property. Thus A £ DNNm,n \ GPm,n- n 


6 More Subclasses of DNN and CP Tensors 

More doubly nonnegative tensors and completely positive tensors are discussed in this section. We 
start with Cauchy tensors. 

Theorem 6.1 Let C £ Sm,n be a Cauchy tensor and c = (ci, • • • , £ K” be its generating vector. 

The following statements are eguivalent: 

(i) C is completely positive; 

(ii) C is strictly copositive; 

(Hi) c > 0; 

(iv) the function fcix) := Ca;™ is strictly monotonically increasing in R”; 

(v) C is doubly nonnegative. 

Proof. The implication “(H) (mz)” follows readily from 0 < Ce™ = for any i £ [n]. To get 

“(zm) ^ (z)”, we can employ the proof in Theorem 3.1 in that for any x £ R”, it yields that 


Note that 


Cx^ = 


E 




= E 






* * * ^im 

Ci, + * * * + Ci, 


f ^Xi.^ • • • Xi,^dt 

■ , Jo 


n,-" Am^[n] 



dt 



dt. 



E (e (i) -•) A 

ie[fc] \*=i ^ ^ / 

E (s (i) " ‘‘•/’■A 

j€[k] \i=l ^ ^ / 

lim 
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with 




eRl^jelk]. 


By setting Ck '■= X) it follows that C = lim Cfc and Ck £ CP^ «■ The closedness of CPm n 

im 

leads to C £ CPm,n- This implies (i). Conversely, if (i) holds, then C is certainly copositive, which 
deduces that 0 < Ce™ = for all i £ [n]. Thus (iii) holds. Next we prove the equivalence between 
(iii) and (iv). Assume that (iii) holds, for any distinct x, y G K", satisfying x > y, i.e., there exists 
an index i £ [n] such Xi > yi, we have 


fc{x)-fdy)=Cx^-Cy^ 


E 


* * * ^irn * * ’ V'^m 

cq + • • • + 


X- — y' 


mci 


> 0 . 


Thus (iv) is obtained. Conversely, if fcix) is strictly monotonically increasing in R", then for any 
i G [n], 0 < /c(ei) — /c(0) = which implies that c > 0. Besides, by setting x £ ]R"\{0} and 

y = 0, the strict monotonically increasing property of fc also implies that Ccc™ > 0. Thus (iii) and 

(ii) hold. Trivially, we can get (v) from (i). If (v) holds, then C is copositive and hence for any i G [n], 

0 > Ce™ = which implies (iii). This completes the proof. □ 


Proposition 6.2 For any given Cauchy tensor C G Tm,n with its generating vector c = (ci, • • • , c„)^ £ 
M”. //c > 0, then the following statements are equivalent: 

(i) Cl, ■.Cn are mutually distinct; 

(ii) C is strongly doubly nonnegative; 

(iii) C is strongly completely positive. 


Proof. It follows from Proposition 16.11 that C is completely positive and hence doubly nonnegative. 
When m is even, the desired equivalence can be derived from Theorem 2.3 in [lOj and Proposition 
15.31 Now we consider the case that m is odd. To show the implication “(i)=> (ii)”, we assume on the 
contrary that 0 is an iJ-eigenvalue of C with its associated i7-eigenvector x. Then for any i G [n], we 
have 



which implies that ^ ^ f]- Thus, 

jeN 


Xi + H-+ = 0, Vt £ [0, 1]. 


By the continuity and the condition that all components of c are mutually distinct, it follows readily 
that xi = 0. Then we have X 2 + P^~‘^^X 2 + • • • + P''~‘^^Xn = 0, Vt £ [0,1], which implies X 2 = 0. By 
repeating this process, we can gradually get a; = 0, which contradicts to the assumption that x is an 
i/-eigenvalue. Thus (ii) is obtained. Conversely, to show “(h)^ (i)”, we still assume by contrary that 
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Cl, ..c„ are not mutually distinct. Without loss of generality, we assume that ci = C2. By setting 
X G M" with Xi = —X2 = 1 and other components 0, we find that for any i € [n]. 



which indicates that 0 is an iJ-eigenvalue of C. This is a contradiction to the condition that C € 
SDNNm,n- Thus the desired implication holds. Note that C is completely positive since c > 0, the 
equivalence of (ii) and (iii) can be achieved by applying Theorem 15.41 □ 


As said before. Fan and Zhou m proposed an optimization algorithm to decompose a completely 
positive tensor. This is an important contribution to the study of completely positive tensor decompo¬ 
sition. Now, our work shows that positive Cauchy tensors can serve as testing examples for completely 
positive tensor decomposition. This is confirmed by computation [20] . 

Recall that a tensor A = € Sm,n is called a Hilbert tensor if _-m+i 

(EZl)- Obviously, a Hilbert tensor is both a Cauchy tensor and a Hankel tensor uni¬ 


corollary 6.3 A Hilbert tensor is strongly completely positive. 


Nonnegative strong Hankel tensors are doubly nonnegative but not always completely positive. 
Several sufficient conditions to ensure the complete positivity of a nonnegative strong Hankel tensor 
were proposed in [miss] as recalled below. 

Theorem 6.4 Let A = be a nonnegative Hankel tensor with its generating vector 

h = (/iQ,..., ^iT'd its generating function f. Then A € CPm,n if one of the following holds 

(i) f is nonnegative, and f(t) = 0 for any t < 0; 

(ii) if the mth order dimensional Hankel tensor generated byh = (ho, 0, hi, 0, ^2 ,..., 0, 

is a strong Hankel tensor. 

Some necessary conditions for completely positive Hankel tensors are presented as below. 

Proposition 6.5 Let A € ^m,n be a Hankel tensor. If A is completely positive, then all its induced 
tensors are completely positive. 

Proof. It is known from Theorem 4.1 in [41] that every Hankel tensor has a Vandermonde decompo¬ 
sition. Thus we write A as A = Yl, where G R \ {0}, = (l, g,k, ■. ■, S K", 

r g 

k G [rj. For any s € [m], the corresponding s-induced tensor Bg = Y can be rewritten as 

k=l 

Bg = Y ^k . Thus, the desired result follows from (ii) of Proposition ICTI bv 

fe=i 

setting a: = □ 


7 Applications 

7.1 Application 1: Preprocessing for CP Tensors 

The completely positive tensor verification and decomposition are very important as discussed in 
(SUES]. In this section, by employing the zero-entry dominance property and a simplified strong 
dominance property called the one-duplicated dominance property, a preprocessing scheme is pro¬ 
posed to accelerate the verification procedure for completely positive tensors based on the Fan-Zhou 
algorithm. The one-duplicated property is defined as follows. 
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Definition 7.1 Let ij € [n] for j G [to] . We say that {h, - ■ ■ , Im) is one-duplicated from (*i, • • • , im)i 
if Ij = ij for j G [m],j ^ p and Ip = iq for q G [to],^ ^ p. Denote • • • im) be the set of 

(^ 1 , • • • : im), where (/i, • • • , Im) is one-duplicated from (ii, • • • , im)- A nonnegative tensor A G Sm,n is 
said to have the one-duplicated dominance property if for any (ii,..., im), where ij G [n] for j G [to], 

— 7 _ 1 \ ^ ■ (jlj ■ ■ ■ ,jm) G • • • , im)} ■ C^-l) 

TJ~t ( 7TZ -L ) 

Easily, one-duplicated dominance property can be derived from the strong dominance property with 
s = to(to — 1) in Proposition 14.61 and hence it is a necessary condition for tensors to be completely 
positive. 

The preprocessed Fan-Zhou algorithm to verify a given nonnegative symmetric tensor A = ) G 

§m,n is presented as follows. 

Algorithm 1 The Preprocessed Fan-Zhou Algorithm. 

Input: A nonnegative symmetric tensor A; 

Output: Certificate for the Non-Complete-Positivity or a CP-tensor decomposition of A; 

Step 0 Set e > 0. Denote 0{A) := {{ii,. ■ ■ Am) ■ = 0}- If 0{A) = 0, go to Step 1. 

Otherwise, check the zero-entry dominance property: Let B = = A. Then, pick any 

(zi,... ,im) € A)(yA), and set — 0 for all {ji ; • ■ • 5 jm } 2 {* 1 , ■ • ■ Dm}- If \\A-B\\f > e, 

then A ^ CPm,n and stop; otherwise go to Step 1. 

Step 1 Check the one-duplicated dominance (7.1). If not satisfied, then A ^ CPm,n and stop; 
otherwise go to Step 2. 

Step 2 Use the Fan-Zhou algorithm in HD- 


Some numerical tests are reported as follows. 

Example 7.2 [Hankel Tensors] Randomly generate a vector f = {fi, ■ ■ ■, fr)'^ G H.’' and use it 
to get a complete Hankel tensor B{f) = {bii,...j^{f)) X) with = (1,^,...,^"“^)^. Let 

ie[r] 

a(.^) = min{t(^), 0} t(^) the minimal entry of B{f), and set A{f) = B{f) — . Such a tensor 

A(f) is always a nonnegative complete Hankel tensor and hence doubly nonnegative by Theorem \3.4\ 
By applying Algorithm 1 with e = le—12, we find that the majority of such tensors A(5)’s can be 
excluded from the class of completely positive tensors by Step 0 and Step 1 as the following table 
illustrated. 


Table 1: Preprocessing for Hankel tensors 


No. 

m 

n 

r 

Perc. 

1 , 000,000 

3 

3 

3 

79.0% 

100,000 

5 

3 

6 

90.2% 

100,000 

11 

3 

6 

91.0% 

10,000 

12 

4 

7 

92.4% 

10,000 

3 

11 

16 

58.2% 

10,000 

4 

12 

18 

56.1% 


Here “No. ” stands for the number of randomly generated tensors and “Perc. ” presents the percentage 
that can be excluded from Step 0 and Step 1 when applying Algorithm 1. This indicates that our 
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preprocessing scheme is very efficient and will greatly accelerate Fan-Zhou algorithm for handling with 
complete Hankel tensors. Besides, this table also tells us that most of the nonnegative complete Hankel 
tensors lie in the gap between DNNm,n cind CPm,n, with some special cases which are completely 
positive. This phenomenon is partially illustrated with the following selected cases with to = 3, n = 11 
and r = 16. 


Table 2: Selected results for Hankel tensors 



a(6 

CP 

Not CP 

Excluded by 

(1.3769, -1.4082,0.1412,1.2897, -0.4949, -0.6248, 
-0.9336, -0.2787, -0.2005,0.1367, -0.8833, 
0.0825, -0.6039, -0.3687, -0.8382, -0.2825)"^ 

-8.2003e-b03 


V 

Step 0 

(-0.7841, -1.8054,1.8586, -0.6045,0.1034,0.5632, 
0.1136, -0.9047, -0.4677, -0.1249,1.4790, 
-0.8608,0.7847,0.3086, -0.2339, -1.0570)'^ 

-1.6321 


V 

Step 1 

(2.5610,0.1966,0.7577,2.0048,0.9201,1.6254, 
1.7530,1.2135,0.2298,0.9929,1.0932, 

1.9353,1.6635,0.6498,2.6199,0.9492)^ 

0 

V 




Example 7.3 [Symmetric Nonnegative Tensors] Note that 


BASIS := 


i E 

m 

1 --ii,-- 

■ •) ‘^m ^ \P'\ ; E * * * E ^771 / 



j 


is a basis ofSm,n. That means, any tensor B € Sm,n can be written as a linear combination of elements 
in BASIS. Henceforth, we randomly generate a symmetric nonnegative tensor as follows: 

^(a) = I 

2l . ,2m €[n] ,2i 

where = randn + t with a random scalar randn obeying the standard normal distribution for 

all ii,...,im € [n], and some positive scalar t. Similar as in Example \ 7.S\ let p{a) = min{7(a),0} 
withj{a) be minimal entry ofB{a), and set A{a) = B{a) — p{a)e’^. Such a tensor A{a) is symmetric 
and nonnegative. Set different values to t and randomly generate 10,000 A’s with each t. By applying 
Algorithm 1, we find that a considerable percentage of tensors can be efficiently excluded by Step 0 and 
Step 1, as the following table shows. 



Table 3: Preprocessing for symmetric nonnegative tensors 


m 

5 

5 

5 

11 

11 

12 

3 

4 

n 

3 

3 

3 

3 

3 

4 

11 

10 

t 

0.1 

0.4 

1 

0.4 

1 

0.4 

0.4 

0.4 

Perc. 

99.5% 

93.8% 

40.7% 

96.7% 

24.5% 

85.1% 

22.4% 

37.7% 


These examples show that our preprocessing scheme may accelerate the verification for completely 
positive tensors based on the Fan-Zhou algorithm efficiently. 
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7.2 Application 2: Tensor Complementarity Problems 

Recently, the tensor complementarity problem (TCP) is studied [5J [3S1 [^ . Let A € Tm,n and 

q € K”. The tensor complementarity problem TCP(g, A) is to find x G R" such that 

X > 0, q + Ax"^~^ > 0, and x^{q + Ax^~^) = 0. 

For strongly doubly nonnegative tensors, we have the following property on the corresponding 
tensor complementarity problem. 

Proposition 7.4 Let A G §m,n and q G R". If A G SDNNm,n, then TCP(q,A) has a nonempty, 
compact solution set. 

Proof. It follows readily from Theorem 5 in [8] and (ii) of Proposition [521 D 


8 Conclusions 

In this paper, the double nonnegativity is extended from matrices to tensors of any order in terms 
of the nonnegativity of entries and iJ-eigenvalues, and the completely positive tensors, as a very 
important subclass of doubly nonnegative tensors, are further studied. Our contributions are three¬ 
fold. Firstly, several structured tensors, which have wide applications in many real-life problems, 
are shown to be doubly nonnegative in both even and odd order cases. It is worth pointing out 
that for odd order tensors, the proposed double nonnegativity, to some extent, can be served as 
a counterpart of the positive seinidefiniteness property for even order tensors. This makes up the 
deficiency that the positive semidefiniteness property vanishes in the odd order case. Secondly, for 
completely positive tensors, the dominance properties are exploited to exclude a number of symmetric 
nonnegative tensors, such as the signless Laplacian tensors of nonempty m-uniform hypergraphs with 
m > 3, from the class of completely positive tensors. Moreover, these properties are also used in 
our preprocessing scheme to accelerate the verification for completely positive tensors based on the 
Fan-Zhou algorithm. Thirdly, all positive Cauchy tensors of any order (even or odd) are shown to 
be completely positive, which serves as a new sufficient condition and provides an easily verifiable 
structure in the study of completely positive tensors and decomposition. In addition, the solution 
analysis for tensor complementarity problems with the strongly doubly nonnegative tensor structure 
is discussed. All these results can be served as a supplement to enrich tensor analysis, computation 
and applications. 
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